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liiis paper describes the philosophy' of intelTigent instructional 
\, systems^ and presents an example of one ^uch system in the doisain of 
Tnanipulative mathem^ticsT-fcLOCKS- The notioh of BLpCRs as a paradigmatic 
system ,i$ .explicated fro© both the system.^evelopment and educatijonal' 
viewpoints. From a developmental point of. view, the modular design of 
bLOCkb provides a vorkiriSg framework t?ithin Which to explore difierent 
monitoring funcftions and varioujs tutoring strategies. A particularly 
.interesting^ discovery that arise.s from experiences with the system is the 
heed for a strjpc^tural model of a studejit to, direct the content and level of 
the^utor'"s comments. -From &n educational viewpoint, BLOCKS provides a 
» aramalic. example of the^ potential of a computerized intelligerrt tutor in a 
^aooratory eovlronment . ' cy oonitoring the stvadent's behavior, the system 
^an notice interesting situations and direct' the student's attention to 
them. In this way, tne computer can provide, conceptual strbcture and 
guidance to a student's otherwise undirected experiences.. ^ 
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.A PARADIGKATIC EXAMPLE OF AN ARTIFICIALLY -iNTELLieEKl 
INSimJCTIOK/iL SYSTEM 

Johrt Seeiy Brown and Richard B. Barter? 

Bolt* Bteranek and Hewrian Inc. • 
^ % , Cambridge, Hass^ | *; . ^ 

This is ^ period of ^raniatic advaaces In computer technology wfiich 
snoaLd Ciharue tne way computers are^ employed in instruction. Technological 



advances wii^ decr^asfe tne cost of computer hardware to the extent that 



wi\l 

•eacn student will nave ' available coiputatiqnal resources ♦ which are 
Currently restricted tc a few elite users, Traditionai doteputer-assisted 
instruction -^CAI) paraaigms were developed under' the assunptiorl that 
comi}:.taWianal power is a scarce resource, and these paradigms »re for .the 
n>Dst part, incapax^le tf exploit in^ t^e latest tecnnologital davances. To 
effectively use^ -Che increased .availability of computational powe>" requires 
a re-eva^uation^of tne* role of tne t^omputer in instructional par*adigms. 

This paper descaioes; reseprcn directed ^ understanding and designing 
artificially intelligent" instructional systems based on AI- paradl^s — 
which ^taxe fv*'ller advantage of increased^ computatfonal power/ TViB kind of 
inistructional sy^stem we are investigating does more than spew fortrN its 
Knowledge' .as factual i/i^ormat ion. It uses its knowledge base and 
probleE-solvipg- expertise to a'id tne student in several ways.. First, *tt 
answers* his questions and car. evaluate nife theories as well as cr^tij^Te his 
solution pa^ns. Second, it aan form structural n^dels of feds reasoning 
strategies 7 These structural nodels are used both to identify h^s 

} K • , 

fundamental misconceptions and to determine ;wheD ahd how^tp provide 
remediation, heuristic recommendations ("hintsT)/ or^ further instruction. 

In addition to the assumed coesputatlonal power, the AI instructional 
paradigm differs from classical £AI in terms of the type of- knowlfedge it 
seeks to develop. We are not focusing on techniques hor teaching factual, 
textboojc knowledge (which can of ten be competently -handled try 
fraice-orient^d CAI or CHI systems)'. Instead > we are focifsing on techniques 
for teaching.^ procedural Knowledge and reasoning strategies which ^re best 
learned through ha/ids-on laboratory or problem-solving task6, during vhich 
the student §ets a^ch^Rce to exeroise his knowledge under the watchful and 
critical eye ot an automated intelligent tutor . TJhat is^ afl * iittelligerit - 



^ instructional' system attes:*pts to m'iEic the capabilities of a laboratory 
instjj^ctor working on a- one-to-one "oa^ls with a student, carefully 
diagnosing what the st^udent Knows, how he Reasons, and what kinds of 

vdeficiencies exist in nis-^cility to' api^lv his factual knowledge*' The - 
SVst^ ^tnis inferred^ Knowledge o^ tne student to determine bo'f{ • 
Dest 'to^ritiQue and/or KiDltz witn nic. ' ' * ^ 

While we are still a long way fros attaining this goal, -we have 
. developed -an organization for intelligent instructional s^stecs, (describe 
in BrQwn .1575j) wnlcn appears fruitful. Our methodology for developing 
tnis organization 'and tne theory underlying it) has been \o explore ^ parts 

. cf tne overall organization in '*paradigc:atic'^ systes^. A paradignatic 
syster is an easi;iy scalfied prototype systea constructed over a carefully 
cr.osen corain of Knowledge. Tr.is cietncdology allows experirentation witli 
soie asp-ect of tne overall system dv sii^plifying other aspects* In this 
paper we descries one of trj?se varadignatic systeins — BLOCKS.- Ve have 
developed systems for otr.er do^^ins iticlading electronic troubleshooting — 
SOPHIE iBrowT, E^^rton and J^ll '9''5 ;'*5rown -et al. 19763; aritfcsetic drill 
and practice — iiEST [r-rt!cn ant Brown 1^6}; elenentjry aigebra [Brown et 
al. ^S"??;; and prcced^-ral sKills in Witmsetic — BUGGY [Brown et al. 
'^iV\^ In additiop, sysi^^rs cf ^slr:ilar spirit are being developed by 
Goldstein [Goldsteir. '^"c; :arr anc Goldstein 1977]. 

/ . • ^ ' 

A r^adiggatic Exarcle - « 

A prerequisite for a par3::i|rr3tic systen is a sutrject dosain that has 

-"^ a sizple anc2 elegant stractur**. Tne domain cost have a logical .forsulation 

tnal is Dotn well-define;^ and <*asily specifiable. In addition, the logical 

\ structures of tne dor^in r^st support natural napping (analogies) into the 

Kinds of complex and real worla dc^ins that instructional systecs are 

wtntended to handle, 

X A dcy^in tnat appears to t>e ideal for this^urpose derives fr<^ that 

part of the world .of manipulatory cathecatics known as attribute iblocks • 
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" iGreeftes . et al-. ' 1972; Clen*»s and Golding 1966; Elep^ntary Science study 

» 

J968]* Although attribute blocKS^'can b^ used to explore a rich variety of 
interesting, c<K:rson-sense reasoning principles, we shall focQS on just one 
application a gar^ which ccc tines the notions of logic, decision-caking 

. -1 . • ■ — ■ 

^ . -2- 



and hypothe9is formation into an interesting exercise on how to ask opt'lsal 

Questions and how to draw Inferences froa the answers. 

^ * » 

Descriptic/n of the Case » • ^ ' * 

This gaise is played with the 32 attribute blocks, a. deck of attribute 
cards and 2 looped strings. Each block has three ^tributes: 
\ SIZ£; scall or larze 

' COLOR: red or yellow or green or blue* . * 
SHAPE: triangle or square or circle or dlaDond * ' 

Tnere is one DlQck in the set of 32 for each possible coabination of the 
values of the three attributes, * ; ^ 

The decx is'^cade up of 18 cards. . Written. on each card is an attribute 
♦ * * 

value or tne negation of a value, 

1. LAPSE 7. TPIANGLE I3. NOT YELLOW 

2. SHALL CIRCLE KOT GREEK 

" I. BLUE 9. SgUAHE I5. HOT^IAHdLE 

*^ FED 1:. Zlkmm 15, HOT CIRCLE 

5. TELLCW n. KOT BLUE- 17. HOT SQUARE 

6. GREEK . 12. HOT 'IS. HOT DIABOHD 

* 

. ,Tn§ student taKes tne two looped strings and overlaps- thes as in 
^Figure 1. This arrangement of tne looped^ strings creates four areas. 'Ara^ 
t is inside tne string on tne left (loop A)'alhd outride the string on' the * 
rignt <loop B),* Area -2 is inside loop B and outside loop A. Area 3 is 
inside both loops. Area ^ is outside both loops, .* ^ 

rne squares labelled Card A and Car^^B in Areas 1 and 2 represent twa • 
cards which the teacher phooses froa the deck of cards. The student is HOT ^ 



told vhtcb car^s have been chosen. The '.object of the gaM/is for thr^ 
student to guess the attribute value written oti each of these . tv6 c^rds. 
To do this the student chooses blocks one at a tiee and ask^ the teacher 
where the block goes (according to the rule that a block placed" inside 
of loop A only if it saWiSfies the value on Card A> and inside of loop B 
only if it satisfies the value Jcsn (5apd B, e.g. If Card A=SQOARE and Card 
BsHOT BLUE, then. the . Large -"^^ellbw Square goes in Area 3). The student 
continues choosing blopljcs, asking where they go, and placing thes there, 
until • He believes Be ^las placed e'nou^ blocks to uniquiely Identify ii.a. 
deduce^) what pach of the cards is. (pe reader is encouraged to play thtu ^ 
garo using p^per and pencil to get a- feeling for the * .types of deductions " 
involved. )' ' / . * 




Figure 1 
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what' can' a computer do for this enVlroncent? 

Manipulatory math, tools represent, In our opinion, one of the best 
uses of simple, inexpensive tecKpoiogy.' It was, therefore, with sOoe 
trepidation .that we- considered <?ontamlnatlng this othervise- simple domain 
with "high technology". However, after* watching nucserous people use 
attribute blocks, we, felt there Here many important tasks that could be 
better accomplished (and in some cases, only accompli|phed) by having ^ 
knowledge -based CAI system. In' particular, ii was clear t-hat* questions 
like "When- have I placet} enough bloci<s?" or "^tfhat is the best next tflock to 
place?" .requires concentration and traKn^tn^ beyond that pf most teachefs* 
Indeed, that these ar:e profitable questions to ask ia seldom appreclattf3. 
The use and import of th^se questions will be jeen in the following 
protocols. 



Protocols 



'In this section,^ we present , three annotated protocols ♦of a 

hypothetical student using BLOCKS. Each protocol builds on the prior one 

and illustrates J additional tutoring features which are realized by having 

trie InstruQtional system take on additional information processing 

capabilities. One of tne Interesting aspects of BLOCKS Ts the way that the 

■domain of attribute blocks gains depth by the^ addition of these 

capabilities . " * ' 

The annotations? >n these protocols include references to components in 

J^e basic architecture of BLOCKS. Figure 2, illustrates *its functional 

decomposition into the ccdules referred to below. The first protocol stems 

/ 

from a relatively simple version of Figure 2 in which there are three. 
iDonitors and a tutor. The Virst monitor (which ' heavily utilizes the 
expert)' evaluates, the student's conjecture about what a card is and 
determines into which ^of the following three categbr,ies the conjecture 
falls: 1) the conjecture is necessarily correct (i.e. the current 'block 
placements entail that card and only that card); 2) it is consistent with 
the' known information (i*e* block placements) but there are still other 
possibilities for ihe, card; pr 3) the conjecture is inconsistent ▼with th 
current block placements. If the conjecture* is Inconsistent, this mp 
also selects a counter-example. The second monitor determines if the 
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placement of a-- chosen block^ could have' beep deduced from .the existing 
blocks, i.e. if' it is a logically redundant block. From * a strict 
information theoretic* point of view, such .choices reflect informationless 
questions. De^jecting si/ch' questions is an easy tasl^ for the monitor to 
perform, but»«-a difficult one for , a - human teacher. The third monitor 
determines when there is suffV^ient information (blocks already placpd) to 
deduce what 'one of the car^s is. ^ * 

These toonitors, are constarntly watching the environment (i.e% student 
moveJ^. ' Tney "waKe up" tne tutor whenever, they detect something of 
interest, ' informing the alerted tutor of what it was that they found worth 
waking him up for,_ The tutor invokes one of several Socratic teaching 
strategies for trying to get the student to r^ll^e ccrxcepts such aS: i) 
the notion of having contradictory evidence to a hypothesis; ii) the 
notion oC having sufficient Information to make a dedtfction; or iil) the 
concept of redundancy' and vhy his particular block chpice was redundant, 

PROTOCOL 1 

The lines with "•»^". in the left column were typed by the ^ studept at 
his own initiative. The lines with "»>" in the left^ colunai were typed by 
the student in response to a^uery by the tutor. 

♦ • ♦ 

WELCOME TO THE ATTRIBUTE BLOCKS WORLD 

rWO CARDS ^VE BEEN CHOSEN. " • ' 

Systfe^-^elects two ca/^ds. . ^ • * ' • • 

CHOOSE > BLOCK 

*»*LARGE Y SQ 

The student 'tells tpe system which block he wpuld liJ?e placed. The 
system , recognizes abbreviations of block flescriptions. 

PUT THE URGE YELLOW SQUARE Ifi AREA 3- . . ' , 

System tells, him where to place his ^ock In accordance with what the 
cards are . " 



•••SMALL yelI-oh Square 

PUT THE SMALt YELLOW SQUARE IN .AREA 1. 
YOU SHOULD Be ABLE TO DEDUCE CARD B NOW. 

The monitor watching the possibilitftes sp^ce wakes up the tutdV fco' 
tell the student a potent ia^fly surprising fact: pere is only one 
possible theory left for Card B even though there isn t a single block 
. In AREA 2 'and /only two blocks have been placed I This is an example of 
the type of Don^toring humans are not yery good at^" 




•••IS CARD B LASGE? 



Student -forms a conjecture. In the -non-computerized version of the 
game, this Uauestlon had only two answers; yes and no. '-That is.- the 
conjecture la 'the same as the card or it is not. The tutor allows 
this to be \ answered irt three ways; Yes, No, or Maybe. 'In this- Case 
LAPGE is t>»e only possible value Card B couid have ; So the answer is 
yes. * . 



YESL, THAT IS CORRECT. 
•••Is 6ARD A SHALL? 



Student forms another conjecture. In this .case . the tutor f Inds ^a 
' counter-example to his conjecture so the answer Ip "no and here s 
why". - V. . - . ' 

NO. IF CARD A WERE SMALL, THEN THE LARGE YELLOW SQUARE 

WHI-efllS IN AREA 3 WOULD BE OI/TSIDE OF LOOP A. - ^ 

•••LARGE Y DI , _ ' ' 

PUT THE LARGE YELLOW DIAMOND IN AREA 3- 




•••IS CARD A YELLOW? ^ ' 

\ The student forms another con lecture. . In this cs^e the tutor informs 
him that his "guess" ^ts consistent with -th^ known information but that 
irt is ju5t a guess oecause there 'are stil]^ other possibilities. This 
is an example of "maybe." Note that a human teacher would have a hard 
tin>e distinguishing this fact 'and would sjmpjy answer yes or no 
depending on whether Card^ A was Yellow! 

IT COULD BE, BUT IT COULD ALSO BE NOT RED, NOT GREEN, 
NOT BLUE, NOT CiRCLE, OR NOT TRIANGLE. 



»**L R CI 

PUT THE LARGE RED CIRCL'E IN AREA 2. 




This pitrticular block performs a perfect spliti of the Tiypothests 
apace, i.e. it rules out NOT GREEN, NOT BLUE, -and NOT TRIANCJLE. 



»»tL G CI . . • 

^PUT the: urge ^GREEH circle in AREA 2. 

, Rules out NOT RED. 



•»»S Y DI 

Monitor decides that the answer to th^t question or bloQk placement 
was deducible from the known information* since .the- blopk the student 
.chose contained both possible^Walues for CARD A (it is'both YELLOW snd 
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NOT CIRCLE); it necessarily had to fall in CARD A s area (AREA T.sirfce 
^ CARD B is LARGE), and therefore couldn t give him any new information 
about the value of Card k\ Since the., student is placing a redundant 
X block, the tutor i3 call^. The tutor triea to get the student* to 
realize that he could predict- wher^e- that block' will fall be/fore it is 
placed • ■ . ' ' 

v. ' ^- * ' ^j* • _^ 
•Where do you think the SMALL YElLOW DIAMOND wtlL go?' . 
»>AREA 1 . : . 

It's true. It could go. there.- • - - * ->v 

Is there anyplace else t^e SMALL YELLOW DIAMOND could go? . j - ' 
»>AREA.n ' , . • ; . \ - 

If the student thinks there is someplace el-se it * cou;Ld ko,- he 
; * * . must have an incorrect idea^pf what Card A could ot (sirtoe he 
already knows what Card B is.) " . ' ' ^ 

What vBlu'e could* Cahd A have* which would- cause * . v.' • 

the SMALL YELLOW DIAMOND to go In Area M? • v . , 

»>NOT GIKLE * , ^ V 

* If Card A were NOT CIRCLE, the ^MALL YELLQW DIAMOND 
would' go INSIDE of ^ Loop A and NOT in Area ^ ^ ^ ^ 

What value cciuld Card A have which would cause 

rrne SMALL YELLOW DIAMOND to go in Area '^?» > 
>»NOT DIAMOND ' . _ r...wr.«'r. 

If Card A w^re NOT 'DIAMOND then the LARGE YELLOW DIAMOND . 
which is in Area 3f would be OUTSIDE of Loop A ' - 

What jvalue coul^ C^d A *have which should cause 

the SMALL YELLOW DIAhK)ND to go^-tfT^r^A il? ^ ^ <. - 

>»ttONE - • 

Is thfere anyplace bsesides Area 1 that the SMALL / m 

YELLOW DIAMOND could go? K ^ V ' ' 

»>N0 , 

When there is only one place a tjlock >an go, it s 
^ not helping you guess what the cards are . ^ ' 

' . 

PUT THE#SMALL YELLOW DIAMOND IN AREA' K 
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„*. alternative -strategy of the tutor when called by the monitor is to make 
the student aware" that his block is not splittirfg his* hypothesis space. 
The following is* an example of this. The Remainder of the protocol resumea 
after the next solid line. . , . , 

: ( . , ' 

CHOOSE- A BLOCK— * - ' . 

"»S Y DI , ^ ^ 

The first step in the strategy is to get theStud^nt to verbalize 
the possible , theories for- the card. If he were wrtfng on any of 
\ them; . counter-examples would t>e given. If there were more 

^' , possibilities than the student" lists-, the tutor would work with 

^ the subset the student gives. 

• ' » ^ * ^ 

Can you tell^e some possibilities for Card A? , • 

»>YELLOW AND NOT CJ^RCLE- ' ^ ^ ' - , * • 

Both of those are poasibilities. . ^ ^ 

Next the tutor asks if his block split% his hypothesis apace. 
Since he believes it' would, the tutor walks him througl) the 
deductions- to show him differently: ^ ' ^ ' ^ . ' 

•Kill the SMALL YELLOW DIAMOND ellminafc* either* of those theories? 
»>YES ■ • 



1 
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wowfld the SMALL II'eLLOW DIAMOND go INSIDE or OUTSIDE 
.of a loop which bad a. card value YELLOW? 

»>IHSIDE. . . • 

Right • . . , 

Would the SMALL YELLOW DIAMOND go INSIDE or OUTSIDE 

of a' loop which had a. card value NOT CIRCLE? 
>»INSIDE , ■ • > 

Rigbt , ' , " ' ^. 

So you know- that t.he SMALL YELLOW DIAMOND goes, INSIDE' of 
Loop A no matt.er which .of those Waluea Card A has. 

PUT THE SMALL YELLOW DIAMOND IN AREA 1. ^ - • • 



" CHOOSE A BLOCK •. . - ^ ) 

•••L Y CI ■ . - • 

PUT THE LARGE YELLOW CIRCLE IN AREA 3- ? 
joU SHOULD BE ABLE TO DEDUCE CARD A NOW. ' " - 

This . block Qontains the negation of one -of Jiie hypoth'eses f^r CARD A 
(NEGATION(NDT CIRCLE) )=CIRCLE; and . HoTd? the other one" constant 
(YELLOW). This La the correct strategy for br'eaking down a hypothesis 
space. The tutor tells him that he did just th^t and should now be 
aBle to deduce the card. 

•••IS CARD A YELLOW ' ' ' 

YES, THAT IS CORRECT. 

YOU HAVE NOW GUESSED BOTH CARDS.' . . . ^ ' " 

— which he doesf ^ 

PROTOCOL 2 * . * ' ^ 

In this protocol, the tutor, is alerted that a card cap be deduced and 
it engages in one or its Socratie dialogues to get the student to ^ee why 
this is the case. ' Nate, these. are the same two block choices that ^ began 
Protocol ' ' ^ . ' ' 

CHOOSEgA BLOCK ^- '• - 

•••LARGE yILLOW SQUARE ' . 

-PUT THE-LA"RGE YELIOW SQUARE IN AREA 3- < ^ 



•••S Y SO . J" 
PUT THE aS^L YELLOW SQUARE IN AffEA' 1 , 



The student ' should be able t.b ffgure out wrtfe Card B is. .But 
instead of guessing it, he pl^cjes ano.ther bloclW 



i! - 



•••L Y DI ' * 

Can you tell me sonse possibilities for Card B? ^. . 
>»LARGE, SQUARE AND YELLOW ' 
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The. tutor asks the student about Card B. It la possible that the 
. , student has Just not "bonsidered It because the^^k^ks both fall 

in loop Av When the student gives three posslblllTles, the tutor 
*'4| evaluates each giving counter-examples to 'the ones whlrsh are 
^ Incorrect. . ^ ; ' ^ ' ' " • 

•Card B c<5uld be UlRGE* - ' ' . . ' 

If Card B vere SQUARE then the SMALL YELLOW SQUARE 
which Is In Area 1 wpuld be INSIDE of Loop*B» ■ , 
And If Card B were YELLOW then the SMALL YELLOW SQUARE / 
which Is In Area 1 would be INSIDE of Loop B» 

By taking the Initiative, the tutor has gotten the -^tiTdent to 
observe that his reasoning Is Inqorrect. 

.PUT THE LARGE YELLOW DIAMOND XN AREA 3/ \ ^ ' ^ ' - 



The third protocol reflects -a substantially expanded set, of monitors/ 
In this version, there are monitors that watch for' instances' when ^ 
higher-order information can be logically deduced' (ix^ides just* the 
identity of a o^rd). Such an example might be .that, ^ given £he current 
placement of blocks, one can l^oglcally conclude that a card could not be 
any SHAPE. ' These more abstract characterizations of the remaining ^ 
possibilities for a card stem from knowing general rules , or principles 
about the structure of this environment. For example, orie rule^ about 
shapes is that if there are two bl<Jcka of t\)i same shape, one of thecf 
Inside a loop and the other outside of a loop, then tbe card for\^hat loop 
can't' be either a positive or negative shape. \Thls is a ncJn-trivial 
abstraction, and helping .students to discover Quch abstractions is a 
worthwhile goal. The third protocol demonstrates monitors for these 
abstractions. 

In addition- to these monitors, the .expert's capabilities^ have been 
expanded to compute a measure of the expected and actual lixformatiorL^ain 
from any particular question^ (i.e. block choice). This information* 
(together with tile ajblllty t6 remove blocks^ which is included in 9L0CKS 
though not shown*) enables the student to experiment with the effectiveness 
of different decision ' strategies and enables the tutor ^ to provide 
substantive hints as *to what is the best next question to ask (I.e. block 
^to choose). Thl3 ' f^ciiity,"^ which would be nearly impossible to realize 
without a cpmputer, introduces tiie student 'to an exceptionally* powerful 
Idea — • namely the 6oncept of actual' vs.' expected information — thus 
providing another poJ.nt of ^^ew on the meaning of a redundant question. 

' -9- ' - 

• ■ . -. ' u ■ '. • 



PROTOCOL 3 



This protocol is the^ same" game that was played in Protocol 1, i.e. 

the same values 'for thej carps -and the same sequence of blocks, in this 

protocol, .however , the information monitor and« the event monito^s have been 
liarned on. The protocol a>so' illustrates the use of the HINT command^. 

rWO CARDS HAVE BEEN CHOSEN. ^ ^ 
CHOOSE A BLOCK— < • 

»**URGB-T SQ ; ^ - 

PUT THE LARGE TELLOW SQUARE IN AREA 3* 

The expected infprlaation conterjt oC that block was 1.0 

The actual information corj^enfwas 1.0 - ^ ' 



perfect 
The bedf 



Tne measure 6f information has been normalijed- so that a 
split of tne hypothesis *.space of both cards is 1.0. 
block generally h^s expect^^d information of about *1'.0. (It is 
sometimes iess than 1 because the initial set of theories is not 
a power of 2 s6 .theory seta of odd number arise.) BLOCKS can 
print oyt the expected infcrmatioa gain of the best block as will 
be shown in the next interaction. 



•••SMALL YELLOW SQUARE ' ' . 

PUT THE SMALL YELLOW SQUARE IN AREA 1. 

The expected information content of that block was .50 

The ^actual information ^content was 1.67 

The best block had an expected information of .99 

. Notice that iv. this case tne stqdent gambled with, a ."bad" block 

^ and won. That is, he placed a block with a low expe.cted 
information but whicn had a very high actual information. The 
information Sionitor provides the student a new tool with which to 
compare strategies 3nd caoose between alternative ways of making, 
decisions. 

Below are the event sionitors which were fired by the placement of 
this block. In future systems, these monitors would invoke the 
^ tutor similar to tne way t.ne placement of a redundant block does 

now. Notice trie numper of event monitors which fired this 
confirms the fact that tne actual information gaineci by this 
^lock was quite high. 



Card B must be size 

Card B must be positiye ^ 

Card B can^t be shaps 

Card B can't be colorr 

Card B can't be negative 

Card B can't be positive snape 

Card B can't be positive color 

Card A can't be size- 

Card B can't be negative color 

Card B'carj't be negative shape 

•»»L Y DI 

POT THE LARGE YELLOW DIAMOND IN AREA 3- 




The expect eel information ^rxt^nt of tri^at^ bloo^ was'»i<J 
The actual information cc^t^nt was-.^l . . 



Ckrd A can't be ^srtive'^^B^ 



I thinks .placing a NOT YELLOW, fClRCLE or^TRIAHGLE would be a 'good idea. 

The HINT cpq^rrd ^'uf^a.-t^ information measure to, determine the 
set of blocks with the highest expected gain. An intenslonal 
description of , this sex is then calculated and given to the 
student. The int-ensional description allows the, student to see 
which attributes 'ar^'^critical to the splitting of the hypothesis 
sp^ace. . ^ 

•••L R CI ■ , . 

PUT THE LARGE RED CIRCLE 'IN AREA 2. ' ' 

The expected Information content- Df that block was .5 
The actual information content -was .5 




••.•HIKT 

I think- placing a NOT YELLOW thing which is not CIRCLE, a BLUE 
thlng»OR a NOT RED .CIRCLE would' ^ a good idea. 



or 



# ■ 

GREEN 



the possibilities for Card A are YELLOW, NOr SED, and NOT CIRCLE. 
These are the biocks that will split this hypothesis space. , 



It must now be clear that 



Ihk,: 



logical inforteation being computed for 



the automated tutor is very large ^d if the tutor wffre simply to pass it 
on to the student. pr, for example, quePy him ^ach time a monitor deduced 
some fact, the student would cbllapse in a state of information overload • 
The tutor is in need of some guiding Drincipies for determining which of 
*this infonaatforrT.s important ^o a particular student at a given moment. 



Rules in the Attribut^ blocks .Domain ' . ' . • 

Experienced students o^ attr,ibute. blocks tegin %o notice Inter^^^ng 
relationships among the placed blocks tliat can lead to conclusions^ that are 
not immediately pbvlous. For ^example, if there ara rid^blocks both Inside 
and oatside Loop A, then Card, A cannot ba^any positive or negative color I 
(Proof of this theorem is, left as an exercise to the reader An expert 
itudant of attribute blocks -reoognlzfes and uses such relationships to guide 
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* ftls ftypothesls formation. The' computerized expert . Iri an Intelligent 
instructional system must be able to do the saine. A central premise of 
intelligent knowledge-t)ased CAI is that; good tutoring can point out 
structure in an environment which might have otherwise been missed: and in 
so doing, it allows the student to enrich his understanding of (and skills, 
in) the environiqent. Thisr statement is .particularly true in the attribute 
blocks dbmain, Vhere much structure exists, afid syoh can be overlooked 
without the Assistance of a tutor.' 

' ' , The attr^ute blocks domain, much like the doma'in'pr geometry , can be 
characterized by a set of- axioms and ^theorems. • Tbk basic axioms of the 
Blocks^^Jorld are ^xtremely simple: Eadh J)lock has^xaqtly three attriSutes 
wh6se. values are selected from one of the three lists, n*o^wo blocks have 
vaore tnan two attribute values in conuDon, etc. A^in^ometry, it is the 
theorems that provide an interesting desdription of the domain*. Although 
'*the Blocks domain can be ^described in a formal mathematical manfeer, that Is 
not the purpose "^f enumerating its ^theorems r the interest here is In 
j)rjovidi^ a basis for p^asping some of tt>e principles of deduction aind 
deiieion making. ' ' ' ^ 

In attribute blocks, as in geometry, "hi^er-level" theorems can be 
built uponVlowep-level*^ ones; that is, there exists a minimal set ^of 
rules from wtJ^ all others can be derived • in the attribute blocks world^ 
this minimal set consists of Just one theorem (also viewable as a pair of 
theorems), along with, of course, the axioms that define the game. (This 
theorem is the first /in the list below J By providing BLOCKS with more 
than this one theorem, the system refiectJa the ability, of people to think 
in higher-levfel terras. ^ - , 

. - l^^set^f four theore^^na' given below represents an effort to enumerate 
those theorems which arei in some way "basic" to t^e attritiute blocks 
domain; easily proyable; most likely to be used by/ a person playing 
attribute^ blocks; ^and a good l^asis for a set of tutoring strategies for 
the game. Note that this set is neither minimal nor exha'ustive. The four 
. theorems are: 
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-Given a Loop L and associated* card C, . • . i 

1. For any block inside L, rule out a^ positive^ attribute values etoept 
, those exhibited by that block, and all negatives of the values exhibited 

by" the block', from the possibilities Vor C. For auy block -outside L, 
I rule out all positive attributes of the block jand all ntgatlves of 

attributes not exhibited by the block, ^ , - ' 

2. If the (positive) value ^ an attribute appears on blocks both Inside 
and outside L, then i^le out all values,' positive and negative, of that 
attribute for C. ^. . ^ 

• 3. If all .values of an attribute ap^pear either Inside L or outside L, then 
rule put all values of that^^tribute fron the^ possibilities for C. 
^. If 2 or more, but not all, (pj^ltive) values- of an attribute aj^ar 
Inside ' L, then ruVe out 'all positive values of that attribute. If 2 or 
sore values appear outside L; tnen rule out all negative values of that 
attribute* , 

A fifth rule,/vnich i5ay seem obvious but la nonetheless ifiportarrt, is that 
if all subcategories of an attribute have been ellxslnated, then .rule' out 
that attribute. ^ \ . . ^ 

Rule .Application . , y ^ . 



t The aBstractions of va\^es Lnto higher-order attributes can be viewed 

as a "theory" tree such^M is snown In Figure 3» The process of deducing a 

card Xti attribute blocks is equivalent to pp^ lai^ ' theory "tree" for 

that card until all but one path frfes the top ik>de to the terminal 

attribute v^lue is 'eliminated. The expert tsaintains thi^ tree by exaelnlng 

the environDent (configuration of placed blocks) and deter^nlng which 

rules are applicable •( 1 ) ^ When It finds an applicable rule, it "kills" the 

tree nodeCs) corresponding to the ellaloated possibilities by attaching' 

^ Information to them on why they were killed » This Inforsation locludes the 

name of the ru'Je that was Invoked and the na©es of the Uio^ks that caused 

. the. r$l% to succeed* .Thus, the •live" nodes are those that have do «uch 
jr P ' . 

Information attached • 



TTrTJne"Tac?~o?'TEe"TTocEs world Is that even though tni ^wo loops 
intersect, their theory thees ai*e Independent, so the expert processes one 
loop at a tise* " , ^ 



ERLC 
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Figure 3 
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The aiigmen&ed theory trees maintained by the rule-rbased expert* 
constitute a large data .base for the tutor. By examining the trees, the 
tutor can answer not only questioas like "Is Card A ^^een?", but also those 

•like "Can Card A be a negative color?", "Card A must be positive, right?", 
and ."Why can t Card A -be a shape?", and provide relasons for its answers 
that the student can comprehend In terms of the theorems. Even with this 
data base^owever, %he problem of how to answer the general question "^y 
can't card x be^?" is complex. For example, suppose ^that the tutor is 
called upon to' explain why Card B* cannot haV.e the value RED. The\tytor 

'men examines the theory tree for. Card^ B and' discovers that the nodes 
POSITI-VE' COLOR, POSITIVE, and COLOR have all been killed,^ a? well as the 
.»tED node. Does tne tutor then explain that Card B can't be RED because it 

^can't* be any color, because it can't be positive, because it can't be a 
positive color, or Just becausfe RED itself is contradicted? 

The solution lies iiR trying to understand the reasoning process i^sed 
by tne student.. If the student, throu^ his block placement and/or 
questions to the tutor', has shown ^ good" grasp of the theorems involved in 
the deductions necessary to rule odt RED, then it is likely that he has 
merely overlooked a placed block that contradicts his ^lypothesis. (2) On 
Ihe other hand^ if the -student has failed to exhibit understanding of 

.theorems, the^ tutor begins its explanation at the lowest level theorem that 
tne student^has failed to grasl?. Thi«, of course, begs the ^ cjlfficult 
question^ of how the tutor can determine what the student knows/' This is a 
continuing research area. • ' ^ 



Syg-tem Description ^ j 

The ^OCRS system has be^'en structured, to allow exf^riqentatien *wlth 
various tutorial and /issistance modules. .For more det/ail, the read^ is 
directed to [^Brown et al, 1975]. In this section we will describe the 
overall ^structure' of BLOCKS, and the workings and responsibilities of the 
individual modules. Figure 2 shows the basic organization of processes and 
data within th^TSiocks system. 



12^ Having overlooked a block is not a possiDiiity ir the tneory tr^ee snows, 
more than one way of ruling out RED wbioh flse different blocks* 
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Executive • • ' v 

The executive has responsibility for the centre^ flow within • *th^ - 
system • ^ The typical control path to proces^s a student 's^statement is as 
fpllows: The executive reads the input statement' from 4 the student and 
passes ' it to the natural language . underit^dej;* The natural languageN, 
understander ixJen^tifies the intent, of the statement ' and /eturns its 
seniantic structure which^ contains the per^inez?t irtformation for one of 
en^JJLnJniDent maintalners (unless, of course, the statement was directed tc 
the tutor or on% of the nonitors]^* The '^executive calls the prope 
maintenance routine which carries out the- appropriate change ^to V^J 
environment. At this point the tutor knows the student's move and wha^ the 
result of that move will be^. ^owev^, before it tells the student where 
the block goes, it can query the student a^ut ^at he had in • mi^ by 
placing that block or he "iian poin€ out things that the student should, have 
Known but didn't (because if he had, his^ present block choice would have 4 
been different). After the tutor has finished, the executive calls the ^ 
natural language generator to tell the student where the block goes* Theft 
the tutor is called (again invoking the monitory) to decide whether tq 
further explain the results of the block choice or the ramifications of it. 

Natural Language Understander 

\ti^ classes of sentences used in BLOCKS to date, have been fairly # 
straightforward and are bandied quickly and easily by a small semantic 
grammar processor [Burton 1976]* The Blocks grammar has ab<iut 15 semantic 
categories with very little complexity. The flexible framework provided by 
the semantic grammar was particularly useful in writing rules to recognize, 
descriptions of blocks. Without it^ the understander would have been much 
harder to write. ^ * 

Jcnvironment Maint^ance - . . ' 

BL(X:KS is designed^^ouq^d the enviroloment of. a student playing with^ 



attribute * blocks. This ^^vironment consists of the values of the \5arddv - 



e theoj^iUju^ 



the locations of blocks which have been placed, and the possible 
for the cards which are consistent with the- placed blocks»<3) Ste tasfes 

13) The list or possibilities can be recalculated from tne oiocks 5u? was 
deemed Important enough to make it part of the enviromaejit . 
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involved In ^maintaining the l)lock5 environment are performed .by procedi^al 
specialists oalle(f environment m^intainers. These tasks include placing 
. and ' removing blocks ' (including f determining vrtiere blocks should 'go), 
printing tbe present boar^*ci<Jhfii|ura\ion, setting up^the-cards to -begin a^ 
game and stopping the session. The effect of each of these maintenance 
actions is to change some portion of the data^ base which is examined tft 
various times by the other modules. 

-Monitors * . ^ ^ . -.^ 

To study the, effects of ^ious types of- Services- which ♦the attribute 
blocks laboratory could provide, varioaa monitors were de^gnfed and 
implemented. He shall describe two: the 'ftemalnfng Possibilities monitor 
apd *the Information Gain monitor. 

'Remaining possibilities moliitor: ' \ > 

In. .order to allow the student to see the Effect that placing certain 
« 

blocks -had on the theory sets for each of tJbe cards, a monitor* was written 
which calculates all of the possible values for each of the capds frc^m a 
configuration of blocks ^ By invoking this monitor via a call to HELP, 
together with being ^ able to remove blocks, the student can discover bow 
certain blocks (questionsO^will split a set of possible th^K>ries. This 
monitor ^ can also inform the tutoring routines when redundant blocks are 
placed or when a set of possible theories is reduced to one element. 

Information Gain monitor: - ' 

The attribute blocks world is an excellent domain to stud/ problems of 
decision-making such ,as what mak:es a good question. The expecJted 
information, gain of a, block and its actual information gain provide a' 
valuable metric for evaluating alternative questions* The expected 
information gain of a block is the sum over the four ac.eas. of the amount of 
information gained by that block ^diling" in that area, times the 
probabili^ty of it falling there,'" {Ttie probability of a block falling in an 
area depends upon th^ remaining possibilities of a card*) The actual 
amount of information gained from a block falling in an area is the 
logaritlvn of the percentage of possible theories that block eliminated . Cin 
the cross product space of theories for card and theories for card B)* , 



• • • 

The logarithm is taken base ^ since each question "has ^ four possible 
ainswera (each block could go in one of four possible, areas) . Since the 
' beginning- theory space has 32M members (I8xl8), the expected number of 
^questions required to isolate one individual element is LOG 32j\ (base k) or 
about ^.2. When the total actual information gain of the 'student 's blocks 
totals he c^n deduce both cards. By seeing both the expected and 

actual^ information gain, the stu^ient^can begin to develop intuitions ab^t 



''good" questions. 



The Tutor and Its Tutoring. Strategies . . d 

The ^utor is invoked when either: 1) the student iks placed a 
redundant block; or 2) 'the student has chosen another block when he 
should have Deen able to deduce a card from the currently placed blcJcks-^ 
rne Tutor attempts through a series of Socratic dialogues to direct the 
student's attention to aspects of the situation that he may have missed. 
Protocols 1 and ^2 sht)w several examples of the Tutor interv^ening in a 
student's session. At present the Tutor has three Socratic strategies: 

1) If the student fails to deduce a card, try to get him , to say what he 
thinks it could be and show him by count^r-pxample where he is wrong; 

2) If the.^student places a redundant block, try to get him to predict where 
. , it will go and convince him that is the only place it could go; 

3) If the student places a re^tjindant block, get hii?) to i articulate some 
remaining theories and to choose a block which would distinguish between 
them. 

From experiments, we have found this tutoring to be valuable although at 
present it is much too oppressive! When to tutor and when not to is a yery 
difficult problem wbos^ tolution* will require a structural model of the 
studvit together vdth a better understanding ' of the effect of various 
teaching strategies. '^One of the purposes of BLOCKS is to provide good 
' framework in which to explore these issues • , * . ^ 

Expert Rule-based" Deduce^* ^ * 

.Since th^ basicr a^ribute blocks rules described earlier represent a 
set of discrete production\rule3, th$ decision was made to use an existing 
prpduction .rule interpreter for theiA implementation. The Rand Intelligent 
Terminal Agent (RITA), whidh was developed at Rand and augmented and 
implemented in INTERLISP by R. Bob.row, was chosen* RITA accepts rule sets 
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in aji. 'English-like notation and translates them JLnto LISE functions which 

/ may thenr be compiled and applied much .liPfe any other LISP funct^ion, ' . 

In (the Lisp version of) RITA, objects are represented , as lisl 

/ structure, in prjDp?rty-list format. The property hames are the objects' 

attributes; and the property values are th^ values of those attributes 

* possessed by the objects. For exampj.es the representation of the 32 

attribute blocks is a list of 32 elements', each of the form: 

(NAME LRS SIZE URGE COLOR RED...) 

One of the primary i^atures of RITA is the ability to ."instantiate" objects 

ba^d dn their^^ attribute^. ,9ffe caVj arlso call other, LISP functions, 

uhether hand-coded^br compileiJ /rom RfTA riile s6ts, from inside a RITA rule 

3et. (i,}^^--^^ j^r, ^ 

An example will serve to illu'sl'r^^te t^e format of RITA rules* One 

rule the main rule set of the rule-iibased expert eliminates the node 

'COLOR frocr^ the theory tree of a loop if the -^same^ color is represented both. 

inside and^ outside the loop. In slightly'^bridged form, that rule looks 

like this: ^ / ^ . . 

rule GOLOR/IN&OUT . ii- ' ^ 

if ^ there is a BL0CKCB1) whose name iSi in XX)NTENTS of LOOP 
and there is a BL0CK(B2) .whose NAME in OUTSIDE of 
^LOOP , « ^\ . . 

and wh6se COLOR is COLOR of BL0CK(B1/L 
then SAyCA^f^TBE( COLOR, NAME OF LOOP, COLOR/mOttT-,'^ 
BLOCK(BT), BL0j;K(B2)i ; 

In this Example, lowercase words are RITA keywords and uppercase words are 
names qf objects and attributes in the^ R?TA environment* LOOP is a 
. parajuet^ handed to the rule set, and has attributes that indicate which 
bl^clcs^ have been placed ' inside and outside of it. SAYCAN'TBE is a LISP 
functioiT responsible for massaging the theory trees. In^ the afctual rule 
set used by lAe the expert, the rules are slightly more complicated to 
eliminate duplicftions and permutations. 

Conclusion 

In this paper,* we have described the philosophy of '/intelligent 
instructional systems and presented an example of such a system (BLOCKS). 

' The notion of BLOCKS as a paradigmatic system was explicated from both th^ 

f 

(4) See the RITA User s Manual IWelssman & Bobrow 1975J for a description 
of t^he operation* and capabilities of RITA* ^ ^ 
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system development; and ,ecJucational points of view. From a developmental 

point of view, the JDOdular design of BLOCKS provides* a functioning 

Cramework within whlbh *to explore* different monitoring functions, and 

various tutoring strategies. _A particularly , interesting discovery that 

ercTse from ^'experimenting with the system was the need for a structural 

model of the student to * direct the content aiid* level of the tutor's 

comments. From an ed^K^ational viewpoint, BLOCKS provides a draa^tic 

ex^inple of the potential of a computerized ' intelligent tutor in a 

.laboratory environment » 'By monitoring the student's behavior, the system 

can notice interesting -events a^nd direct the student's aHention to them. 

In this 'way, ' the computer can actually provide conceptual structure and 

gu-idance to a student's otherwise undirected experiences. 

' / ' * ' 
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